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ABSTRACT 

The focus-group interview format was used to 
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interviews were planned for each of the following groups: (1) school 
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administrators? (4) central office staff? (5) parents? (6) Career 
Ladder teachers? and (7) non-Career Ladder teachers. Despate the 
diversity of the seven focus groups, their comments yielded some 
common themes about the Career Ladder program. The most dominant was 
a perceived overall lack of district readiness to adopt a program of 
the scope and magnitude of the Career Ladder program and a lack of 
needed organization. Related to this finding was the expressed need 
for an agreeri-on curriculum, A separate focus group for the Career 
Ladders Pilot District Network served as a check on the internal 
validity of the conceptual structure being piloted in the district, 
and it defined concerns about program implementation. This group was 
far more positive in its evaluation of the developing Career Ladders 
program than were the school district focus groups. Fcllow-up 
interviews were conducted with five of the seven focus groups 
(parents and central staff could not be rescheduled). The focus group 
format is a powerful tool for validation of the theoretical model for 
program development by giving all groups a chance to express 
themselves, (SLD) 
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INTRODUCTION 

Overview 

The evaluation of a con^lex educational refom program such as Career Ladders requires a data base 
which thoroughly captures aU possible aspects of the implemenUtion process. Such programs typically 
produce multi-faceted, and sometimes unprcdicuble, effects upon existing school structures and key 
personnel. As a result, restricting t!ie analysis to only those outcomes which are readily identifiable and 
Qu a nt i fi a ble (e.g., standardized test scores of students) might yield an incomplete picture of the program^s 
tnie magnitude of effects. 

Perh^s the uldimate indicators of the status of a change process are the attitudes, perceptinns and 
feel i ngs of the people who are affected by it on a day-to-day basis. Organizational theory has long since 
demonstrated that the most weU-intentioned change effort can fail miserably if adequate understanding and 
support of its participants are not taken into account. Therefore, an accurate monitoring of such behavioral 
variables is absolutely essential to a valid evaluation process. 

The major limitotion of more traditional approaches to measuring behavioral outcomes has been a 
possible "error of omission." Subjects' responses have often been restricted to those particular items (often 
a Likert-typc atritudinal written survey scale) presented to diem by the researcher. However, no outside 
evaluator, whether well-intentioned or thorough with respec: to pretesting, could ever comprehend the "true 
inner workings" of a program quite like the subjects themselvc»s. By allowing these participants to "tell the 
story in their own words," the evaluator could gain access to potential program outcomes and effects which 
he/she might not have thought to measure otherwise. 

A research technique known as "focus-group interviewing" is a well-esublished procedure for 
collecting such potentially valuable data. Originally developed in the areas of consumer behavior and 
mariceting research, it has more recently been successfully extended to evaluation research in other fields 
(Higginbotiiam and James, 1979; Kniger, 1988). In focus-group research, a relatively homogeneous group 
of between four and twelve participants is asked a series of carefully sequenced, open-ended questions 
(known as a "questioning route") designed to elicit their attitudes, perceptions and feelings concerning a 
product, service or process. The latitude of response option and possibility for response alteration as a 
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result of interaction with one's fellow interviewees is the primary advantage of focus-group data over more 
traditional numerical measures. As a result, the research may acquire a more thorough, complete and 
accurate picture of the way in which the imxluct, service or process is actually being perceived by affected 
individuals. 

The present study utilized the focus-group interview format in order to investigate the existence, 
interrelationship, perceived strengths and indicators of insufficiency within the support and focus factors of 
the developmental process effecting educational change and reform. Such case-study research is known as 
"explanatory," since its primary purpose is to validate a theoretical model in an actual applied context (Yin, 
1984} That is, by probing subjects' perceptions of the components of this model, one can determine if the 
hypothesized elements do indeed exist and q>erate in practice as assumed. 

The implemenution of the Career Ladders teacher-incentive program in a rural Arizona career 
ladders school district was the primary focus of the validation of this hypothesized developmental model. 
Specifically, according to ihe schematic proposed by Yin, this constituted a "single-setting, embedded" 
(several distinct strau of respondents, interviewed separately) cast ^dy . Questioning routes were developed 
to elicit subjects' perceptions of the support and focus factors of this model, as it applied to their particular 
experiences with the Career Ladders program. Additicmal details of the design methodology are given in the 
following section. 

Focus-Group Interviewing Prtx:ffdure 

A total of two interviews was planned for each of the following groups of this rural Arizona career 
ladders school district's subjects: school-board members; Career Ladders steering conmiittee; administrators 
(principals and assistant principals); central-office staff; parents; Career Ladder teachers; and non-Career 
Ladder teachers. As is customary in focus-group interviewing, each of the foregoing groups was 
interviewed separately. Each interview session lasted between one and one-and-a half hours. 

During the first session, the model of support and focus factors was distributed to all participants, in 
order to presensitize them to the proposed theoretical structure of the Career Ladders model. This procedure 
was followed in accordance with the explanation-building proposed in the research design of this particular 



focus group. The individual questioning routes elicited respondents' perceptions of the existence, 
intcntIadonships» strengths, and weaknesses of each of the conqwncnts of this model. 

A separate focus-group session was conducted with the members of the Career Ladders Pilot 
District Network (CLPDN) between the first ard second series of focus groups held in the rural Arizona 
career ladders school district. The CLPDN interview was conducted in oidcr to establish the internal validity 
of the scries of questioning routes being utilized in this rurd Arizona career ladders school district In other 
words, the questions were in effect being pilot-tested for their clarity, thoroughness, and relevance to the 
theoretical model. 

The second round of focus-group interviewing in this rural school district included all but two of the 
aforementioned groups: the central-office staff and the parents could not be scheduled However, in order to 
correct for this unplanned contingency, the researchers decided to conduct a separate, "open-group" session, 
where partiripants unable to come to any of the previous sessions could have an oppor^1nity to express 
their view?;. The questioning routes for the second round of sessions were carefully developed to probe 
repeatedly expressed and/or emotionally charged areas of interest which were evident from the tapes and 
transcripts of the first set of sessions. However, as is customary ir such settings, the moderator departed 
from the established route(s) as needed, in order to pursue tq)ics of discussion which sparked special interest 
in more depth. 

Several common themes emerged from both sets of focus-group interviews, as well as from Uie 
CLPDN validation ses^on. All three sets of interview? wiU be discussed in more detail in the sections ♦hat 
follow. Results will be summarized per group in each set Sunmiary conmients wiU identify preliminary 
conclusions and recommendations implied by the three sets of results. 

Results of the Rural Arizona Csreer Ladrfpn: .^ir^i^] 
District Focus-GrouD Interviews: Fin;t fSwiV^; 

Each of the above group meetings will be sunmiarized in the order presented above. They will be 
organized around broad topic areas related to the model of sui^rt and focus factors. 
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Focu<;>rfmup Interview wit h SchnnURna fd M f mhm 

This session concentrated primarily on the areas of student achievement, lack of curriculum, 
program designs and structures, and organizational climate deficiencies. Several comments were also m-ioe 
concerning administrative support and the role of the steering committee in program in^)Iementation. 

Considerable discussion revolved around the necessity to link program goals to the assessment and 
iii?)rovement of student achievement It was noted that proper long-range planning and identification of 
commonly-agreed-upon goals were needed, yet sorely lacking, due to the lack of curriculum in the district 
Furthermore, development of such a district-wide curriculum must meet the unique needs of the school 
district, rather than being based upon national norms and standardized materials. Such long-range joint 
curriculum planning would correct the current year-to-year operations, according to one participant, "... so 
[that] the program doesn't go around in cirdes." 

Optimism was expressed concerning the district's ability to implement a long-range planning 
process and to refocus the CL program on student-achievement and teacher-effectiveness objectives. , . 
we just need to iron out a few of these wrinkles [in order to incorporate student-achievement assessment] . . 
. [the program] must get down lo bare bones [& we must] try to make it work . . 

Along tiiese lines, subjects noted that the evaluation system must be realigned to assess 
effectiveness more clearly. One person expressed the concern that the legislature will require good 
evaluation instruments as a condition for program continuation. 

One vividly mentioned objective m developing a teacher-effectiveness program focused on student 
achievement was the need to overcome negative publicity concerning students* performance in the distrct 
One respondent mentioned a recent newspaper article in the Arizona Republic which labeled this school 
disuicf s students as having standardized test scores below the national average levels. The resultant harmful 
effects upon students* and teachers* self-esteem of such publicity were then discussed. This subject stated, 
*'Let*s make liars of the news media and bring up our scores." The desirability of an agreed-upon 
curriculum, as well as a properly functioning teacher-effectiveness program, was sef;n as instrumental in 
attaining this goal. 



In terms of CL program designs and structures, a number of existing problems were identified by 
school-board intcrvricwees. For one thing, it was noted that some CL teachers were working on 'trivial and 
meaningless' projects in order to accumulate credit for program participation. This pcRon suggested that 
perhaps projects should be more carefully audited by some outside party in order to establish their releva ^ce 
to students' learning. 

A second detrunent to classroom performance was the excessive amount of paperwork required of 
CL teachers. The observation was made that some of dicse teachers were doing this paperwork during class 
time, while assigning students busy-work in tfie interim. 

The training and peer-evaluation requirements of CL were a iiird hindrance to teacher performance of 
classroom obligations. Such programs were identified as resulting in teachers being removed from the 
classroom for large amounts of time. One person noted that this seriously in?)aired die necessary one-to- 
one interaction which teachers should have with their students. 

Regarding CL program requirements, the rules themselves were cited as too confusing. One board 
member noted the need to phrase these requirements "in layman's terms." FurthermcM-e, another respondent 
took exception to the progressive nature of the "ladder" itself. He observed, "Everyone's stuck at the middle 
of the ladder . . . pushing to get on top." 

A repeated focus of discussion was the motivatiwi of program participants. References were made 
to "deal-making," "fast-tracking," and the need fcM- teachers to concentrate on students' needs, as opposed to 
"get-rich-quick" motivation. 

A number of interpersonal problems were identified and discussed at this point CL was thought of 
as "labeling" a person, with such overt separation as CL and non-CL teachers sitting apart at meetings. 
Along these lines, the existence of considerable lack of team-building, jealousy and dissension were noted. 
One particular source of this jealousy, as explained by one subject, was the incidence of spouses both on 
CL and earning $ 40,000.00 apiece. 

School-board members briefly noted the need for administrative suppat in order for the px)gram to 
be properly functional. Principals and assistant principals need to communicate more with participants, as 



well as with the steering committee. Regarding the steering committee itself, subjects expressed a need for 
positive publicity so that the program and its accomplishments will . . really sparkle." 

The session concluded with an expressed need for community support, especially with regard to 
refocusing the goals of the program. One person £*.aied, "Somewhere along the line it drifted from its 
original concept and is now thrown around like a hot potato." 

Focus-Group Interview with Steering^Cnm mittee Member s 

Considerable time was spent discussing the issue of administrative leadership with this group, as 
well as the coordinator's interaction with administrators. Teacher effectiveness, leadenhip and focus on 
student achievement also generated interest Some disagreement and opinion divisiveness was apparent 
within the steering committee on these issues. 

One area of such divisiveness was the question concerning the need for a district wide curriculum. 
This was identified as a current issue of deliberation and discussion in recent steering-committee meetings. 
There were clearly mixed feelings in ". . . being told what to do ..." if a district- wide curriculum were 
developed and mandated One person also referred to the *' threatening" manner in which goals v/ere currently 
being communicated, w'th obvious concern that a district-wide curriculum might be imposed from above in 
the same dysfunctional maimer. 

On the other hand, it was pointed out that such a long-range and agreed-upon plan would help 
eliminate tht problem of teachers setting so-called 'trivial* objectives. Another steering*committee member 
pointed out beneficial side effects such as consensus and team-building, which would result from 
development of a commonly-agreed- upon curriculum. This subject illustrated the point v^th an actual 
example of current evaluation procedures, whereby each teacher developed five objectives to be met jointly 
with his/her building principal. 

With regard to student achievement, the idea of documentation and accountability of teacher 
activities was agreed-upon in principle. One person liked the notion of identifying ". . . what works and 
what doesnl" 



Administrative leadership in general was characterized as dictatorial. The superintendent was 
identified by one steering-committee member as saying [about the CL program]: 'Itll go, no matter what." 
In particular, central administration was perceived as creating botUenccks with respect to coordinator 
attempts to implement committc decisions. (One subject colorfully characterized the massive bureaucracy 
involved in getting committee decisions implemented as dealing with "... a cast of thousands.") Steering- 
committee members specificaUy identified signs of administrative indifference and hostility to the program. 
These included such wanting signals as: repeatedly placing CL concerns last on meeting agendas; delaying 
paperwork on steering-committee decisions delivered to them by the coordinator; and displaying signs of 
disinterest by their conduct and body language in all interactions with the coordinator. One participant 
stated that ". . . you must sec a meeting in action . . jw-esumably to convey the frustration and 
ineffectiveness perceived on the part of the steering conunittee. 

Jealousy was mentioned as one possible cause of the problems experienced with administrators. 
One individual felt that administrators might feel threatened, since some CL teachers' salaries now exceed 
those of assistant principals. 

However, comments were divided some^/hat on an overall, long-term assessment of administrators' 
involvement in the CL program. In one member's opinion, central administration is defmitely more tuned 
in, receptive and understanding of program goals this year. 

There was also clear disagreement of the role of tiie program in promoting teacher effectiveness and 
leadership. On the one hand, according to one respondent, it is difficult to know if teachers would not have 
been effective r -en without the program. However, a second committee member described the functioning 
of the CL program in hiv academic department as providing models for optimal teacher effectiveness; that 
is, ''selling success," or serving as an "umbrella" which could protect and nurture experiments with new 
methods and qsproaches. 

Even more debate ensued witii respect to the topic of peer cvaluators. One subject praised the 
candor, thoroughness and value of peer evaluation, as opposed to more traditional feedback received from 
administrators. "They [peer evaluatorsj don't seem to mind telling you [what principals won't]." As a 
consequence, the "nudge" received from die peer feedback was more useful in in^roving teaching methods. 
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However, this view was not universaUy shared within the steering committee. A second member 
pointed out the negative effects of teacher s^lf-esteem which sometimes resulted from such peer candor. 
According to this respondent, this peer feedback sometimes resulted in hun feelings, a poorer self-image (1 
thought I was a good teacher before hearing this*) and even a disenchantment with the entire teaching 
profession. 

The topic of organizational climate generated interest and illustrations of primarily negative factors. 
Particip^jtts mentioned lack of trust; jealousies; lack of feedback and disregard of ideas proposed; violation 
of confidentiality; and an ovcraU climate of negativity. There was also a shared perception that some of the 
teachers placed at the highest (HI. IV) levels were not sufficiendy competent, which served only to fiiel 
further resentment. One individual characterized this as . . go[ing) along with the fiction that all teachers 
are equally the best." On the positive side, the CL program was credited with the important intrinsic resuh 
of promoting "competence nwrivation," It was also acknowledged that the CL program was in fact being 
blamed for other, pre-existing organizational-climate problems. There was clear disagreement on the topic 
of whether problems would be solved by scrapping the CL program. 

Several consistent comments and suggestions emerged with respect to program designs and 
structures. Foremost among these was the need to integrate program conqwnents which hal been operating 
in a fragmented and isolated manner. The need for long-term planning prior to haphazard implemenution 
was also exp) ed 

Focu?;-rirouD Interview with Prindpak and Assistant Principak 

The primary topics of discussion with administrators were the areas of student achievement, 
evaluation, and leadership. The area of organizational climate, as well as administrators* involvement in the 
program generaUy. sparked particular interest 

Principals and assistant principals expressed concern with the apparent lack of program focus on 
student outcomes. (An initial response to the question. "Do you measure whaf s expected?" was derisive 
laughter and the reply, "Is this a trick question?!") Iii the subjects' view, the CL program has not yet 
resulted in improved teaching and learning. Currendy suted student objectives were criticized for two 
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reasons: being trivial in some cases (an example was given of a teacher wishing to ". . . track daily 
attendance and link it to student achievement") and not incorporating such essential indicators of student 
growth as affective, social and emotional factors. As one respondent observed. "Students with social and 
emotional problems need to be dealt with before they can achieve weU." ITiis situation was attributed to 
the lack of an overall curriculum; that U, teachers were being forced to generate objecdves in isolation. 

The CL program structure was faulted for not being properly focused on teacher effectiveness and 
student progress. The entire group enthusiastically and wholeheartedly agitcd with the opinion of one 
administrator that the program needed to return to this basic purpose, as opposed to merely ". . . going 
through certain steps." Furthermore, the best possible outcome of the program ought to be . . knowing 
[that] one is a better teacher . . .," as opposed to churning out ". . . canned lessons . . ." mechanically in 
Older to satisfy the program requirements. 

There was expressed oisagreement with respect to the CL program's role in developing effective 
teacher-leaders. For one thing, according to one administrator, there was no visible difference in the 
performance of CL and non-CL teachers. Another person felt that "... the same persons would be 
puRuing leadership regardless (of the CL progrr.n]." A third person faulted the CL program for its too- 
naiTow focus: that is, only on tangible classroom acitivites, with no provision for evaluating the more 
global and general professional attributes of its participants. A summary comment was made along these 
lines concerning a perception of ". . . teacher leadership without direction." 

Considerable interest and discussion centered around administrators' participation in the CL program. 
There was a strongly expressed and shared perception that principals had been effectively excluded from 
playing an active role. One person characterized the exclusion as ". . . foggy activity going on in the 
central office . . ." which was not shared with principals. With respect to program inception, administrators 
were not involved in the initial design and implementation. The program was characterized as being ". . 
modeled [after] some programs down in the VaUey and [developed by] the steering committee." To this day, 
according to participants, there was no information sharing or satisfactory involvement with the steering 
committee. One person expressed a desire to play a more active role; yet, "... no one's asked us!" 



This perceived lack of input and ownership was paralleled by frustration with the CL evaluation 
process. One subject resented the need to spend eight to ten hours filling out the evaluations while at the 
same time having no say in the CL placement process. As a consequence, some principals and assistant 
principals have resigned themselves to their lack of buy-in and have turned their efforts to more rewarding 
and satisfying activities. As summed up by one participant "... from the principals' viewpoint, cuher 
things art more important" 

Proi*am designs and structures came under fire for inequities in placement, as well as excessive 
required paperwork. With regard to the fonner, there was spirited discussioi about the fact that too many 
people were starting out it top levels, some of whom were not qualified. This placement resulted in unfair 
work loads for some teachers, as well as a lack of motivation to in^rove (as, with initial top placement, 
there was literally no place to advance). Another administrator related the example of a teacher in tears and 
feeling overwhelmed due to the burden of necessary pq)erwork and the consequent time taken away from 
other teaching duties. In addition, some requirements of program participation were criticized as being 
trivial in certain cases. One subject commented that participating teachers now want credit for everything 
that they do, such as helping out at school dances. The deficiencies in program design and implementation 
were summed up by one administrator as . . rewards for those who write well and write quickly." 

Discussion of organizational climate spariced perceptible interest and emotion of participants. The 
announcement of the focus-group meeting itself, in fact, wa« described as coming from a memo which left 
people with the suspicion that the meeting itself was contrived. The negativity generated by idle 
complainers was also pointed out, with one person stoting, . some won't be happy with whatever 
transpires." Finally, one individual noted a distinct con^lacency on the part of CL teachers, who al^e<;edly 
refuse to volunteer for activities which non-CL*s agree to handle. 

The fmal area discusi^ with administrators dealt with their perceptions of the role and effectiveness 
of the school board. The board was praised foi its recognition of the aforementioned morale and 
organizational-climate problems. On the other hand, one person felt that the board's support of tliC goals of 
the CL program would only last as long as the available funding. Another characterized the board as being 
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"... as much in the dark as we." One subject expressed the opinion that the board needs to be composed 
primarily of teachers in order to be optimally effective. 

Focus^Group Interview with Central-Offir^ Staff 

Discussion with this group centered primarily on the issues of jvogram design and inq)lementation. 
Recommendations emerged with respect to the overall planning process and the necessary focus on student 
achievement outcomes. 

A repeated criticism of CL jrogram design was the obsenred tendency of its elements to operate in 
isolation. One subject pointed to the coordinate's office and likened the current situation to Federal 
programs hastily instituted and subsequently genera'ang a whole separate and cumbersome bmeaucracy of 
their own. A second group member presented this colorful analogy: "[It*s like] trying to build an engine to 
ride uphill, but we don*t have all [of] the parts ... so [that] we end up pushing it uphill." 

An integral reason for this problem, according to central office input was the lack of careful 
planning and direction prior to program implementation. One perron observed, ". . . [we] can't just 
introduce a program and let it loose." A lack of staff input and involvement in the planning phases was 
pointed out The school district was also characterized at not being at a sufficient readiness level; as a 
result, much planning and direction had to be done ex-post One individual held up the support and focus 
model (which had been distributed prior to the interview session) and commented that an actual program 
needed to be tailored carefully to the unique needs of this rural school district, as opposed to serving the 
needs of, say, Phoenix and Tucson. 

The current program d;;sign was also criticized on several other grounds. One person observed that 
the CL program q^pears to reward longevity, as opposed to student outcomes. Two others noted, ' WeVe 
overquantified things and imposed paperworic unrelated to student achievement;" and, "The quality of the 
program has been lessened in favor of quantity.** 

Along these lines, subjects identified a lack of agreement on common curriculum and goals as 
contributing to evaluation problems. There seemed to be confusion on the pan of all participants as to 
what "effective student outcomes" ought to be in the first place. One central-office mem'l)er commented that 
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they had already tried four or five evaluation systems and are still unable to relate specific behaviors to 
desired student outcomes fairly and consistently. There was consensus with the observation that specific 
teacher competencies need to be identified, specified and linked with student progress in order to implement 
an effective evaluation system. 

In terms of leadership, one person stated that the teacher-to-principal ratio in their school district is 
twice the national average. This situation made it esr^eciaUy cumbersome for principals to handle an extra 
30% of evaluations and pq)erw(^ associated with CL requirements, according to this subject 

Discussion of organizational climate was comparatively nunimal for the central-office group. 
However, several problems were briefly cited, among them a lack of effective communication and distrust. 
One participant noted, "Every little move is a conflict" 

The group concluded by proposing several recommended solutions to the aforementioned problems. 
Primary among these was a vision, or focus, with the emphasis or. student achievement Administrators 
also needed to play a more active role in the program. Finally, it was felt that money should be de- 
emph^sized as an incentive in the reward system. 

Focus-Group Interview with Parent?; 

This group proved to be lively, well-motivated to share ideas and concerns, and sincerely interested 
in their children's academic progress. They generated a list of practical suggestions to increase parental 
involvement in the educational system 

One parent pointed out that the school district already has tremendous potential in the form of 
untapped resources that could be used to enrich the academic experiences of its children. A reference was 
also made to the school system in Asia, where there is continuous interaction between teachers and parents. 

Along with this topic, pai-ents eagerly shared their frustrations with respect to the boredom and 
apathy which they sense on the part of students. One participant recalled the school spirit which was 
formerly in evidence when she herself was a student Another parent mentioned a special program designed 
to teach young children to play the cello which he recently observed in Phoenix. He described the joy and 
eagerness with which these students learned and wondered why similar programs could not be tried in the 
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school district, as now "... the only big thing here is athletics . . This issue of wanting to re-motivate 
students was reiterated several times in the discussion, with much genuine concern obvious on the pan of 
the parents* 

Related to the general disinterest of students were the more serious problems of discipline, tardiness 
and absences. One subject commented that there exists on paper a tribal law to the effect that parents 
should be notified in the case of an unexcused absence; yet. it is not enforced. This individual prominently 
referred to the need to restore parental accountability, in the form of assuming responsibility for the child's 
regular attendance at school. Another person, agreeing with the lax and inconsistent enforcement of school 
rules, conmiented that "... the district is caught in the middle . . ." between indifferent students and 
parents. 

The following ideas were eagerly put forth as possible solutions to increase parental involvement 
and motivate students: 

1 . parents and grandparents helping out in the classroom (with respect to the latter, mention was 
made of the "Granny Program"); 

2. latchkey programs for middle and upper grades; 

3. older students setting up nxx:k businesses (akin to "Junior Achievement"); 

4. utilizing students themselves in the teaching process, to tutor their peers; 

5. classroom projects designed to introduce students to different career opportunities (one such 
program, requiring the students to interview and report on persons holding different 
occup;:tions within the community, was described and praised by one of the parents); 

6. increased computer-skills enq)hasis (one such program currently being conducted in Leupp was 
mentioned as an example); and 

7. moTt information dissemination to parents themselves, such as the need to prepare a handbook 
so that parents would be mcxe aware of school rules and policies. 

The CL program itself was a topic more of curiosity than specific criticism, alluding perhaps to its 
hasty and fragmented implementation which was also discussed in other groups. Parents asked the 
moderator to describe its purpose and operation and were sincerely interested in the responses. At this 
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point, one particq)ant commented, "We need mae infonnation on Career Ladders . . . why haven't teachers 
gone for this? I see it as a way of getting ready motivated teachers, as opposed to those who just go for the 
paychecL" 

The isolated operation of the program was noted during the discussion as well. One person asked, 
"Why did the steering committee develop as an isolated bureaucratic structure?" Anotlier observed, "It 
wastes everyone's time when programs operate in isolation.** 

In addition, the overall lack of long-range planning and direction prior to implementation of the CL 
program in tfiis school district was mentioned With regard to the current perceived status of the program, 
one parent summed up the situation by characterizing it as . . a complacent system which has grown 
roots . . One possible remedy proposed was the idea erf a year-round program, with comparison made to 
a similarly operating school district in Albuquerque. (The moderator observed that such a year-round 
working obligation is similar to the way in which jobs are structured in the business world.) 

The parent group reacted very positively to the moderator's reedback that . . youVe not alone in 
having [these] problems. School organizations are structured bureaucracies. You Ve recognized it and u jne 
something about it . . . [you] took a risk, since the program has exposed problems . . The discussion 
concluded on an optimistic and positively reinforcing note, with the moderator telling the participants that 
. . there ARE ways to get the excitement back!" 

Focu5;-rfrQup Interview with Care er Ladder Teachers 

The overall tone of this discussion was emotionally charged at several points. In particular, the 
evaluation system and the present organizational climate engendered a lively interchange. 

There were several distinctly positive responses to the area of student achievement, which was raised 
early on in the discussion. It was agreed that the goal of the CL program had bien presented to the teachers 
as retaining and rewarding those teachers who work toward student progress. One teacher also noted that 
teachers are now being held accountable for student learning. In addition, it was suted that one or two 
social/emotional/behavioral objectives are being built into the goals set by and for teachers in certain 
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settings. A third person stated that the percentage of mast^^ry on the ITBS and criterion-referenced tests has 
increased each year and is now up to 75%. 

Focusing more specifically on teacher accounubility, all of the participants agreed that teacher skills 
have improved measurably. For instance, there is now a greater focus on areas like analysis, synthesis and 
closure in the preparation of lesson plans. Another person observed that new ideas are being openly 
discussed and shared, among both CL and non^IL teachers. 

The overall positive tone of the comments began to shift, however, with the introduction of the 
topic of the evaluation system. One individual did praise the intent "This is the only program where 
someone asks, 'how did it Desson] turn out?"" Other related comments were, . . someone finally 
noticed." and "You now know what they're looking for . . ." (with reference to a detailed instrument 
containing 31 specific areas to be rated on a five-point scale). Another teacher singled out the peer* 
evaluation traming as being especially relevant. This person noted that one's basic skill level, self- 
awareness and organizational skills are enhanced as a direct result of this training program: ". . . fyou] don't 
get stale." 

On the other hand, the cumbersome nature of the requisite paperwork came in for some heavy 
criticism from the CL teachers. The instrument was described as being much too lengthy, in particular the 
necessity of writing in a "ratiorzale" for each area being evaluated. Another teacher noted the last-minute 
nature of the development of the evaluation forms, observing that it seemed as though someone had just 
thrown it together at the eleventh hour. Finally, the need for separate evaluation systems for "special 
personnel" was cited. 

Some divisiveness was apparent within the group when the topic of adminiscrative leadership was 
raised. One source of frustration was a consistent lack of communication and feedback from central 
administration in response to their teachers' ideas, questions and problems. This situation was compounded 
by tremendous uncertainty as to the actual chain of command and decision process; one teacher characterized 
administration as simply being "... up there somewhere.** With regard to administrative sipport for the 
CL program generally, one teacher described it as "... at best, it*s more of a tolerance." 
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However, there was majority agreement to the premise that principals need more of a buy-in into 
the CLj,. ^am in order to function effectively as leaders within its structure. The teachers returned to this 
point, in fact, during the total discussion. A suggestion was also made that principals receive explicit 
training to improvt their accountability. 

The next area of discussion with CL teachers was the lack of curriculum. Respondents readily noied 
the lack of direction; it was characterized variously as " . . . doing our own thing . . ." md ". . . [the] rules 
change after the game starts . ..." One person recognized the need for standards, or benchmarks, in order to 
have an effectively functioning evaluation system, as discussed earlier. 

Teacher input and communication were seen as particularly lacking. With regard to the former, 
one teacher suted that, "We just saw [decision] in finished fwm and wed say. 'this is what we decided on!" 
Another noted that the teachers stiU don't have a 1989 calendar; this person recognized a critical need for 
feedback concerning long-term planning and goal-setting. Communication, when received, was likely to be 
garbled at best: ". . . versiwis of stories change." Along these lines, the planning and execution of 
meetings came in for special criticism. For one thing, meetings were sometimes announced the same day 
that they were intended to be held, prompting one teacher to ask, "Are they discourteous? Disorganized? 
Incon^tcnt?" Furthermore, the meetings themselves were perceived as repetitive: "[they consist ofl the 
same people asking the same questions." 

A number of distinct problems were identified as part of the overall organizational climate. One 
person commented on the stress of unreaUstic deadlines, in particular when the teachers were told just eight 
weeks ago to come up with a curriculum by May. An incident was described concerning stolen mail, 
pointing up the issues of distrust and breach of confidentiality. 

One area of organizational climate came in for special attention: the alleged existence of dissension 
between CL and non-CL teachers. There was a noticeable silence when the moderator initially asked 
whether this was, in fact, true. Then die teachers began to describe specific problem behaviors. Prominent 
among these was the charge that non-CL's were idle complainers. One person suggested Uiat they were 
actually reacting emotionally to "two-year-old rules" which were presumably no longer in force. Another 
CL teacher characterized die climate of unsubstantiated rumors as "complaints but no solutions." A thiid 
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claimed that CL critics would actually like to ,ee the money incentives divided equally, in annual 
increments. As a final ixmy in this area, one subject pointed out that the school with the most such critics 
act»ially also has the greatest number of ^licants for the CL program. 

Near the end of the discussion of this area, it was conceded that the climate between CL and non-CL 
teachers has perceptibly improved on a year-to-year basis. It was also noted that teachers in general are 
woridng on creating a more pleasant and positive environment 

The moderator asked the CL teachers to assess the effectiveness of the steering committee and the 
school board, respectively. With regard to the former, all of the tcacLers agreed that the steering committee 
was made up of extremely hard- woridng individuals. However, the teachers would like to get more feedback 
from the steering committee. Most participants had no cq[>inion on the effectiveness of the school board, 
with one person explaining that the members are too new to gauge their performance at this point At the 
same time, only one teacher believed that the board can be characterized as "open-minded" or "unbiased" 

The topic of intrinsic motivators brought the tone of the disct'ssion back to a positive note. One 
teacher acknowledged the recognition and professionalism inherent in the program, Strang, "It's the first 
time somebody's ever lo<*ed" at teacher performance. 

With respect to monetary incentives, one person liked the idea of a marketplace-like assessment of 
"worth" which was implied by the incentive schedule. However, another commented that there was some 
confusion and lack of information generally as to what the salary schedule was supposed to be. 

Tt t final theme discussed consisted of program designs and structures. There was clear agreement 
with the idea that there should be a choice with respect to participation in the CL program. Another person 
thought that the master's degree ought to be required for movement up the ladder, akin to professional 
licensure prerequisites in the business world. The discussion again turned positive towards the end of the 
session, with one teacher admitting that Xareer Ladders has forced lots of good things.*" 

Focus-Gmup Tntgrvi>v/ with Non-Career Ladder Teachers 

This group, like its CL counterparts, was eager to share opinions relative to several aspects of the 
program. Two areas singled out for lively discussion were student achievement and organizational climate. 
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A number of serious allegations were made about teachers trying to manipulate the student- 
achievement reporting requirements of the CL program. Among other things, teachers were accused of 
"teaching to the test;" repeating lessons and/or testing until the desired percenuge of "gain" is numerically 
reached; deliberately not teaching well during the first several weeks, so as to show a higher "gain" score 
overall; teachen being told by the superintendent to "show gains" regardless of their actual numeric results; 
and teachers actually altering the sccMies themselves. (With regard to the last allegation, one person said that 
the teacher had actually been overheard bragging about the illegal action in the teachers* lounge. 
Furthermore, this offense was repcmed to the school board, but nothing was ever done.) One proposed 
remedy to help prevent offenses such as overt coaching for tests was having teachers exchange classes. 

Along these lines, one non-CL focus-group participant made repeated mention of a distinction 
between so-called quantitative "gains," computed between two test administrations, and the notion of a more 
repeated, systematic "monitoring," a "sampling" of student achievement The latter should be the focus of 
the evaluation system, according to this teacher; yet it was seldom applied in practice. Instead, the process 
inevitably turned into a "dog-and-pony show, " according to this person, with performance directed soldy to 
the (narrow) criteria, (Interestingly eiiough, teachers were identified as not being at fault for these abuses. 
Instead, "the system" itself was blamed.) 

The problems in establishing clear evaluation criteria, and the frustration in adequately assessing 
student achievement, were linked to the lack of an overall curriculum. Respondents noted the lack of 
administrative involvement, stating that the persons who conduct the evaluation do not have a say in the 
placement process. There was some disagreement within the non-CL group, however, when the issue of 
peer evaluation was raised. Some participants felt positively about peer evaluators, with one person stating 
that peer evaluations were better than those conducted by principals. The training received by peer 
evaluators was perceived as being insufficient; one teacher pointed out that it consisted of only two 
sessions, with one session being held on a Saturday. Several teachers felt that peer evaluators gave scanty 
feedback at best; one teacher was told only that "you teach above-level" by a peer evaluator who was not 
even from th? same academic area. Another teacher admitted that the only time she types her lesson plan is 
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for formal cvalutions; in particular, she criticized the detaU required. Finally, one teacher observed, 
"Assembly-line evaluation doesn't help student achievement." 

The subjects briefly mentioned that they would like to sec more administrative accounUibility. 
Communication from the top was characterized as insufficient, with one teacher asking "What were the 
results of the "movement committee?'" Another pointed out that memos are circulated three or four times 
yearly, piiesumably to solicit teachen' input as to ideas and suggestions; yet, there is invariably no feedback 
on teacher comments submitted in response. 

The tendency to place applicants at top levels immediately came in for heavy criticism here, as in 
other groups. One person noted that a Level m placement is perceived as a "stigma," when in fact one 
should feel proud to work one's way up from, say. Level I. CL applicants were identified as having the 
attitude, "If not at Level IV [at initial placement], why go for it?" 

In addition, die group responded witii laughter at one member's account of a recent applicant's 
"informational" experience. This applicant was allegedly told, "there's not as much paperwork now" 
required by the CL program. AnoUier "familiar" area of dissatisfaction, as having surfaced in other focus- 
group discussions, dealt wiUi CL teachers being pulled out of their own classrooms for inordinate amounts 
of time, in wder to fulfill oUier program requirements. 

The CL coordinator was perceived as untrustworthy and not objective. He was alleged to have said, 
"I'll keep the program at die expense of die kids and everytiiing." In particular, die coordinator was 
criticized for inconsistent application of CL program rules and especially for seemingly arbitrary extension 
of deadlines. Respondents characterized interactions widi him as be;-^^ ^personality conflicts.' 

The area of organizational climate, as stated at die outset, generated emotionally charged responses 
and particular interest The biggest complaint leveled against CL teachers was dieir alleged reluctance to 
share ideas and to give detailed, meaningful feedback to dieir non-CL counterparts. The CL program itself 
was characterized as a "club," widi overt ostracism and broken friendships as its consequence. The non-CL 
teachers resented Uieir apparent labeling (by CL's) as 'just gripers/ In addition, ihey resented being made to 
feel guilty if diey chose not to apply for die CL program. Respondents in turn characterized CL teachers as 
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being unprofessional, as weD as "having sold ouf for personal gain. They also beUeved that the overall 
organizational climate had deteriorated from cooperative to purely competitive. 

Summary Comments: First Sgries of Fncii?;- GrQup Tntervigwfs 
Despite the diversity in background and interests of the seven focus groups, their comments yielded 
some common themes with regard to the CL irogram and its implementation. These will be briefly 
summarized below. 

Perhaps the most dominant issue to emerge from the discussion was i perceived overall lack of 
district readiness to adopt a program of the scope and magnitude of CL. The lack of long-run planning and 
subsequent haphazard implemcnution was repeatedly noted in the focus-group sessions. 

Related to this is the frequently expressed need for an agreed-upon curriculum. Commonly shared 
goals would benefit both the desired program focus upon student-achievement outcomes (also discussed 
direcUy below), as weU as the esublishmcnt of clearly suted benchmarks to expedite and improve the 
evaluation process. 

In terms of program designs and structures, all of the participants seemed to agree in principle with 
re-establishing teacher effectiveness and acccunubility for student achievement as the primary focus. 
However, the actual structure of Ae program is perceived as being paperwork-oriented; unv^ieldy; poorly 
communicated; inequiuble (in quick initial placenients at Levels m and IV, leaving applicants with no 
place to progess, as well as engendering problems in self-image for those who happen to be placed at lower 
levels at first); rcwart!ing teachers for relatively trivial and meaningless activities; and resulting in teachers 
being out of their own classrooms for inordinate amounts of time thereby ironically jeopardizing the 
"teacher accountability" which is supposed to be the mission of the program in Ae first place. 

Administrative leadership is seen as sorely lacking, in part justifiable due to principals' lack of buy- 
in into the CL program. They are burdened with excessive paperworic, while at the same tin^ being denied 
key decisicm-making responsibilities such as participating in Ae placement process. 

The organizational climate was primarily described in negative terms during the entire scries of first 
focus-group sessions. Problems such as mistrust, jealousy and divisiveness (CL vs. non-CL teachers) were 

20 



repeatedly cited On die other hand, there was not a clear agreement that the CL program was. in fact, the 
cause of these problems. Indirect evidence for this conclusion is provided by numerous allegations of "idle 
conq>lainers" who are unable or unwilling to state specincally their reasons f<Mr dissatisfaction with the CL 
program. 

Results of Career Laddgn P ilot District NefwnrV 
Validation T=hriy<.^rrffl|p jntmiftVi^ 

As mentioned earlier, a separate focus-group interview session was conducted with the members of 
the Career Ladders Pilot District Networic (CLPDN). This interview was teld during the CLPDN*s regular 
monthly meeting, with the prior consent of the membership. The duration of the interview was between 
one and one-and-a half hours. 

This separate interview constituted the validation sample for the focus-group sessions being 
conducted in the rural school district That is, the questioning route for the CLPDN was designed to 
determine its overall appropriateness, in terms of the support and focus model being validated in the rural 
Arizona career ladders school district. CLPDN members were asked specific questions designed to assess 
their perceptions of the existence and interrelationship of these factors. The questions posed by the 
moderator to the members of the CLPDN paralleled the order and sequence of the factors as they speared in 
the theoretical model. In addition, the moderator skillfully probed the same issues with the CLPDN which 
had repeatedly surfaced with respect to the nwdel components during the initial round of interviews in this 
school district The responses of the CLPDN thus served as a check on the internal validity of the 
coiceptual structure being piloted in this district 

The CLPDN focus-group session generated considerable respondent interest and input Particular 
comments will be summarized accwling to the broader themes of the model to which they pertained. 

The first area of moderator questioning dealt with the role of outside policy-making bodies, such as 
the state board and the legislature. CLPDN members focused on the issue of accounubility. More 
specifically, policy-makers were perceived as needing to see some tangible positive outcomes, in the form 
of increased student achievement, in return for the dollars being allocated to teacher-incentive programs: 
that is, a form of cost-benefit analysis. It was felt that this objective could also be attained by increasing 
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"good press" which would reach the legislative cniiiies. Other focus-group members commented on the 
desire for more local control on die part of districts in establishing die specific policies and procedures of 
the CLP, widi outside policy agencies relinquishing some of their specific control. 

The need for a solid planr Jig phase prior to actual program implementation was discussed next. 
Respondents agreed strongly with the need to have "readiness factors" in place to help insure successful 
experiences with new programs and policies. R)r one thing, sufficient "seed money" needed to be available 
for use during these initial stages. Another individual observed that Phase II districts, in particular, had 
experienced a real time crunch with respect to start-up activities. 

Documentation of student achievement constituted a relatively large proportion of CIPDN 
members' interest and discussion. As before, die issue of teacher accountability was mentioned. One 
person felt that the documentation requirement had inq;)roved accountability in two ways: by focusing 
teachers' attention on more specific criteria of assessment, and by providing dieir evaluators a clearer sense 
of what is expected of teachers. This notion generated wide agreement, with anodier person commenting 
diat it was necessary to defme "what does teaching really do?" in terms of observable, measurable outcomes. 
Anodier felt diat clear criteria are also beneficial in terms of lessening die stress associated witli the teacher* 
evaluation process. 

According to diis person, teachers have tended to be afraid to test for outcomes if they are not 
concretely specified. In anodier CLPDN member's opinion, teachers did not have any incentive to 
demonstrate accounubility and systematically assess dieir own and dieir students' progress prior to die 
requirements imposed by the CL program. 

Another person felt diat documentation had also inqyroved the overall conmiunication process, as a 
sort of positive side-effect In particular, he/she felt diat conununication had improved among academic 
departments, across schools, and within die district as a whole. As a result, diis person identified a clearer 
agreement as to common goals among these entities. 

A sub-area of outcomes came in for special attention: die moderator asked whedier social and 
emotional goals were being explicitly incorporated into student-achievement objectives. There was clear 
agreement with doing so in principle. As one respondent observe^ die way in which a cliild feels on a 
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given day can markedly affect classroom performance and test results. Thus, teachers' awareness of affective 
factors needed to be raised by whatever means possible, even if it meant holding teachers accounuble for 
these objectives. Another noted that a student's overall level of satisfaction is an integral aspect of the 
entire learning process and should be assessed in some way. One CLPDN member stated that social and 
emotional goals are currently apart of his/her district's CL evaluation system. 

The challenge of developing valid and reliable measures for social and emotional outcomes was 
mentioned. However, this person also stated that this potential difficulty should not be used as an "excuse" 
to avoid assessing affective outcomes in the first place. 

CLPDN members' interest picked up noticeably with the moderator's introduction of the 
professional input, ownership and teacher leadership areas of questioning. The CL program was identified 
as fostering leadership qualities in its participants, as a result of such formal stnictures as mentoring 
opportunities. Another remarked, "Teachers are getting control of their own destiny and future." 

Moreover, the idea of teachers sharing ideas and new developments generated a considerable amount 
of interest. One respondent effectively related this inq)roved communication to the aforementioned problem 
of isolation. According to this individual, people tend to feel most isolated when they do not have ready 
access to a common base of knowledge. However, this feeling had perceptibly diminished recently, due to 
the increased interchange among teachers. 

The CL program was also credited for distinct inqmvements in the area of administrative leadership. 
One person noted that, in his/her district, the CL peer evaluators are required to "teach" the evaluation 
system to administritors. This practice has resulted in greater skills and understanding generally on the part 
of principals and assistant principals. Another CLPDN member felt that the CL program implemenution 
had effectively resulted in an intrinsic motivator for administrate^^ as well. This is because they now have 
a much better idea of vMbL is going on in the classroom, as well as greater focus on producing better-quality 
teachers within their schools. Perhaps due to these reasons, there was a shared sense of greater 
administrative support for the CL program than had been evident dirxing prioryears. 

A number of negative effects on administrators were identified by focus*group participants as well. 
Administrators were perceived as feeling insecure and threatened by the idea of sharing decision*making; the 
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idea of surrendering "turf' was mentioned. (This was balanced, however, by an opinion that such sharing of 
responsibilities can wot effectively if all pardes are perceived as acting with integrity.) Others commented 
on the principals' disenchantment with the large amounts of time and money required for CL 
implementation. 

The evaluation pror«ss triggered lively discussion as to whether there should be dual instruments 
(for CL and non-CL teachers). All agreed that a single method of evaluation should be in place. However, 
some practical problems with the single approach were identified. For one thing, one person suted that 
there were "two different meanings" associated wiA identical ratings being made for CL and non-CL's. 
Specifically, according to a second CLPDN member, there was son resentment of the fact that more 
money was linked to superior CL evaluations, but not to equ'tfly superior non-CL ratings. 

Finally, it was observed that principals iiiq)licitly tend to expect mwe from their non-CL's, which 
in turn triggers comparisons and jealousies. (This problem, as previously, was not recognized as being 
serious by all of the focus-group respondents; there was some disagreement) 

On a more positive note, respondents acknowledged diat the evaluation process has triggered a need 
to reach consensus on the outcomes and behaviors which constitute so-called "good teaching." In other 
words, teacher effectiveness is being taken much more seriously as a desirable goal to be assessed. As a 
result, much more explicit identification of "teaching tasks" is taking place. 

With respect to motivators, the extrinsic motivator of money received relatively brief attention, 
being mentioned by only one respondent. To balance this, a wide variety of intrinsic motivators was 
mentioned hy focus-group participants as being associated with the CL program. These included the^ 
following: 

1 . increased teacher self-esu;em; 

2. increased teacher skills pro. » jtency (opportunities to share one's knowledge and expertise with 
colleagues in a positive interactive manner); 

3 . (as a direct result of above role expansion) greater self-validation, and self-actualization; 

4. job-enlargement, job-enrichment (by having this q)portunity to expand one's professional role 
and take on additional d^ies); and 
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5. genuine teamwork and cooperation (as opposed to working in isolation, so frequently 
mentioned as a problem in the teaching profession generally). 

The moderator's introduction of the topic of "de-motivators" at this point produced some spirii ' 
interchange. The first problem mentioned was that of potential bumv of . . highly motivated 
overachieveres who want to do it all." Related to this was administrators' observed tendency to overuse 
such ove«chieving candidates in the first place. The second and final area of de-motivating factors was the 
excessive papcnvoric associated with CL. As one person put it, there was still a distinct tendency to ". . . 
over-describe and over-document." However, the participants acknowledged a recent trend toward 
streamlining the documentation required; in their view, it was gradually becoming more concise and 
efficient Another person observed that "There's no easy way to start the documentation expertise," 
suggesting Aat there was an ineviuble learning curve' associated with developing mxt efficient evaluation 
procedures generally. 

There was clear disagreement within the CLPDN group as to the CL's effects upon the lecruitment 
and retention of top-quality teachers. One person expressed uncertainty as to whetfier the program was in 
fact producing the desired effects. Another countered with the opinion that CL seems to be getting the 
better, newer leacheri to suy in the teaching profession for a longer initial period of time; that is, ". . . 
[they're] not opting out as early " 

The discussion of the organizational climate yielded primarily poi^itive feedhack a distinct 
departure from the overall tone of this component in the first round of focus-group sessions. This was 
especially surprising, in that the moderator broached the topic in a carefullv open-ended manner "How has 
organizational climate been affected by the program?" 

Among the positive outcomes identified by CLPDN meml>ers were the following: 

1 . inq)roved teacher-administrator ccmununication; 

2. improved communication among schools and levels; and 

3. inq>roved trust (especially when the staff began to observe the overall positive effects of the 
CL program on improved teacher skills development). 
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In addition, otc participant alleged that one of the most frequent allegations made about the CL 
program was not true in his/her district The charge that parents want their children Uught only by CL 
teachers, wiA associated dissensions and dissatisfactions, was totally unfounded, in this person's opinion. 

The area of ncaatiifi organizational-climate outcomes was itself broached in a rather unique and quite 
positive manner. A vivid point was made by one CLPDN member, relative to the stresses invariably 
associated with the change process, such as implementation of the CL program. According to this 
individual, some initial negativity is almost to be expected as a matter of course during this time of 
temporary system disequilibrium; one would almost be suspicious if there weren^t a perceptible drop in 
organizational climate during this time. 

Two other general points were made relative to negativity in organizational climate. One person 
observed, "[We] must WORK at 'climate' . . noting in particular the evolutionary and sometimes 
tenuous nature of this component. Another person commented that negativity often resulted in necessary 
dialogue between or among opposing parties, paving the way for positive progress in the negotiation and 
resolution process. 

A limited number of specific examples of dysfunctional organizational climate were mentioned. 
The evaluation process came under fire for triggering such unintended negative side effects as stress: "[One] 
must be a super teacher [in order to show] a gain . . thereby resulting in excessive pressures on teachers. 
Other apparent interpersonal divisiveness was attributed to salary and age differences within the staff. 
Another person warned of the need to guard against so<:alled "cultures," or cliques, which tend to form 
within organizational structures. 

A couple of specific recommendations were made by CLPDN members with respect to 
improvement of organizational climate. One thought that jealousies and accusations of "special privileges" 
could be appreciably reduced by making CL-based inservicc and other special programs open to all interested 
parties. Along these lines, it was noted that there should be more publicity about the benefits of such 
special training, thereby increasing general interest in the positive outcomes intended to be provided by 
CLP. 
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One key suggestion was made relative to improving the role and function of the steering committee. 
One person believed strongly that the local governing board must explicitly incorporate teacher 
c^anizations Li an active way. He/she pointed out that it would be pdidcally dangerous to exclude these 
organizations, especially during the criticid initial stages of the planning process; thai is, they needed to 
have a conoete "buy-in." 

A second individual remarked that the steering committee also needed to have non-CL-leacher 
representation. (According to this person, the committee did realize this rather late but now specifically 
includes diis sub-group in its membership.) 

Finally, it was pointed out that the steering committee needed a greater diversity of opinion. The 
governing entity would benefit from being forced to field a variety of questions, input and comments 
generally. 

Program designs and structures were brought up next by the moderator. Respondents expressed the 
opinion that there was little knowledge or agreement on the components of a "good" CL model at first. 
However, it has gradually evolved into an improved and well-specified structure, especially with respect to 
the training and responsibility requirements which should be in place at each level. In particular, 
respondents noted a greater level of stability and constancy in the current overall program design. 

With respect to legislative guidelines, participants noted that they have in general been well received 
by the districts. In their opinion, this was due primarily to the legislature's willingness to grant 
considerable autonomy and flexibility on the local level in districts* program design planning process. 
Participants also felt that the idea of a periodic comprehensive review of legislative guidelines would be 
advisable, as a sort of internal audit 

Ongoir^ district-level research and development activities were perceived as a "must" in order for 
local CL programs to continue to survive and in'4>rove. Research results were seen as providing much- 
needed credibility to all proposed changes, if solid findings were available to back up reccnrmiendations, it 
would help insure that change is not perceived as being "arbitrary," "done for its own sake," etc. Another 
individual elaborated on this point, stating that staff have tended to be suspicious of decisions being made in 
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an "ivory-tower" manner. In this person's view, change would receive greater team support when all of 
those affected by it have access to the rationale behind it 

Respondents were eager to elaborate on specific aspects of the change process. In response to the 
xnodtrator*s request to ". . . identify what has changed, in both positive and negative directions," they 
produced a detailed list of inqvovements. The beneficial results of the change process, as identified by the 
CLPDN membership, included the following: 

1 . teachers feeling a greater sense of professionalism; 

2. teachers feeling a greater sense of accounubility for student learning (". . .we're beb<; more 
purposeful . . ."); 

3 . improved teacher skills development; 

4 . increased prominence and perceived importance of the evaluation process itself; 

5. improved quality of documentation procedures (e.g., portfolios being prepared and submitted 
by CL teachers); 

6. a gradual but perceptible streamlining of the documentation required for the evaluation process; 
and 

7 . an increased number of teacher observations. 

At this point in the interview, the discussion focused on issues of district readiness to support 
programs such as CL. This issue once again generated considerable respondent focus and overall interest 

Three areas were specifically mentioned by QPDN members as not being sufficiently ready for CL 
implementation. Theie were the evaluation process as a whole; the documentation process for teacher 
evaluation; and the lack of a cohesive, all-encompassing and agreed-upon curriculum. With respect to 
curriculum, one person labeled it as ". . . being there . . ** but not currently being given serious 
consideration by teachers. The only discernible progress in this direction, according to another respondent, 
was that ". . . CRT tests have been looked at, updated and rewritten." 

According to the CLPDN, finance and funding was too narrowly specified. One person thought that 
it was stipulated so as to benefit "... a large district with many teachers on the CL." There was an 
expressed need for a minimal dollar amount to be budgeted to cover administrative expenditures, so as not to 
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put kOMller districts at a disadvanuge. Another problem related to insufficient funding being available for 
inservicc and outside-consultant activities. It was suted that most of the available total money must go to 
cover teacher salaries, teaving Uttle or nothing for such essential teacher-development activities. 

The CLPDN focus-group intriview concluded with the respondents being asked to offer other 
suggested improvements. One person felt that Phase m districts are in dire need of better-formulated long- 
range planning strategies, as weU as sufficient time for the planning process. This penon voiced his/her 
frustrations concerning hasty implementation, eleventh-hour rewriting activities, and a requirement to 
complete six sets of evaluations, all during a relatively short interval of time. 

Others mentioned the desirability of utilizing outside resources on a regular basis. For instance, 
mention was made of tiie Far West Ubs presentation, which had preceded tiie CLPDN focus-group session, 
dealing witii the Career Udders program in Utah. Another tiiought tiiat tiie Arizona Education Association 
(AEA) could be of greater assistance (especially to straggling Phase m's) witii respect to inservice and other 
communication activities. A tiiird individual felt Uiat there ought to be more coUabwative-type of activities 
between and among different districts, such as inviting one's feUow CL districts to share in bringing in 
outside speakers and seminars. 

Summary Comments: Can yr Ladder Pilot DUfrirt 
Network Fncin-fimnp V alidation Intwvipu/ 

The session witii CLPDN members essentially corroborated tiie existence, interrelationships and 
importance witii tiie proposed support and focus-faaor elements of tiie CL model. Panicipants reacted 
positively and witii interest to tiiese elements as presented tiirough tiie questioning route. This serves as 
evidence of good internal validity, or specification of tiie model. 

There were distinct areas of agreement, as well as disagreement, witii tiie comments made by tiie 
rural school district focus-group participants. Botis tiie CLPD)«I and tiie school district subjects agreed 
strongly witii tiie inqwrtance of focusing a program such as CL on tiie assessment of student achievement 
outcomes and related teacher accountability. 

The notion of "district readiness" also received considerable respondent attention and agreement. 
The related issue of evaluation piocesses also generated respondents' interest in botii groups. There was 

29 



clear consensus on the desirability for a uniform instrument for both CL and non-CL teachers. On the other 
hand, while the current evaluation instruments were perceived as being too cumbersome and elaborate in 
some cases, subjects generally felt optimistic about the eventual focus and streamlining of the evaluation 
process. 

Both groups were able to identify key areas which needed massive in^rovemcnt before a program 
such as CL could be successfully inq)lemented. Iliere was clear agreement that certain factors were not at a 
sufficient level of development to support successful in^lementation of a program such as CL. The need 
to identify these underlying factors, as well as to spend carefully budgeted amounts of time and money in a 
long-range planning process, were acfaiowledged in both settings. 

With respect to motivation, both groups contradicted a finding which had been almost consistently 
labeled as a "negative" of the CL program: the issue of money. While there was some acknowledgement 
of jealousies inherent in salary differences, overall the two groups tended to downplay the overall 
significance and importance of this factor. 

The topic of organizational climate came ui for ronsiderable interest and discussion in both groups. 
One area of obvious agree;nent was the evolutionary nature of organizational climate; that is, the need to 
monitor its status on an ongoing basis and move in the direction of elective change as needed. 

Despite these areas of distinct overlap, there was distinct disagreement in opinion between the rural 
Arizona career ladders school district and the CLPDN focus-group participants. Perhaps the sharpest areas 
of difference v; in teacher and administrates leadership. CLPDN subjects feit that there was far more 
sharing of ideas among teachers going on than did the rural school district subjects. Administrators were 
also identified by the latter group as not having a sufficient "buy-in" into the CL system, >vhich perhaps 
explained their lack of input The CLPDN members, in contrast, characterized the level of administrator 
involvement in primarily positive temis. They also felt that principals and assistant principals were 
playing an increasingly significant role in CLP implementation and development 

With respect to organizational climate, both sets of respondents' interest levels were identically 
high; however, the emotional tone of their feedback was not When the topic was raised in an open-end^ 
manner with the CLPDN, the feedback given (relative to the effect of CL upon organizational climate) was 
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overwhelmingly positive. This was not the case with the rural school district's participants, however. 
While some positive effects were noted by these subjects, the bulk of their time was spent in identifying 
dysfunctional interpersonal effects. 

In general, the CLPDN session could be characterized as validating the support and focus factors 
which had been hypothesized prior to the focus-grout) research. In the third and final phase, a foUow-up 
series of focus-group interviews was conducted with the school district subjects. Individual questioning 
routes for this second round were carefuUy developed to probe special sub-areas of respondent interest and 
involvement which became evident during the first series. These will be elaborated in the section to foUow. 

Results of thft Rural Arirnna Paregr T .arfHPT^ <irh^] 
District FnTiK-nmiip Pror^uns: HerixnA K^^^ 

As mentioned earlier, the basic fonnat and procedure for conducting the foUow-up interview sessions 
was similar to that of the first focus-group series. However, the questions posed to each sub-group during 
the second round were designed to concentrate more on particular areas of interest which had emerged during 
the first interview. 

In addition, three of the original seven groups were unable to be scheduled for a second interview. 
These were the school-board members, the central-office staff and the parents. To compensate for this 
unforeseen contingency, Ae reseaix:hers decided to hold a special "open-group" session as the last focus- 
group interview. The planned puipose of this open group was to accommodate any and all panic ipants who 
could not come to a regularly scheduled interview session. By doing so, it was hoped Uiat a mon thorough 
and representative sampling of opinion would result. 

FQCUS-nrniin Tnfpirvipw with Steerinp-rn mrniffpa Mpmhpr^ 

Two topics seemed to occupy tlie general interest of these subjects during the second interview 
session. These were the perceived lack of administrative support, especially as it affected the other support 
and focus factors of the developmental model; and the issue of organizational climate. 

Steering-committee subjects repeatedly focused on their perceived apathy of administrators relative 
to all aspects of CL program implementation. This was especially evident in administrators' refusal to 
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attend stecring^x)ininittec sessions, despite attempts to acconunodate meeting times to their own schedules. 
(One steering-committee member colorfuUy pointed out that, for those principals who HAVE attended 
special workshops, etc., ^ . . [they] wouldn't be able to teU you three or four main themes of ^effective 
schools'!") Furthermore, subjects pointed out that steering-committee business was repeatedly placed Jaa on 
meeting agendas. When mention of CL business was made, principals typically signaUed their disinterest 
and boredom with their body language, according to a third subject 

This lack of administrative support was especially evident in the communication process. One 
steering-committee member related the account of the announcement of the second focus-group meeting 
itself as evidence of this problem. According to this individual, the meeting was announced at the end of 
the sixth class period, just three minutes prior to the closing beU. Furthermore, the announcement itself 
was not even made by a principal or vice-principal, but by a member of the office staff, which seemed to 
serve as further evidence of lack of importance. FinaUy, the details of the announcement were garbled, 
further confusing the intended recipients. 

Perhaps symptomatic of poor communication with administration generally, there seemed to be a 
murky perception of the decision-making structure. In response to the moderator's probe, the subjects were 
unable to identify y^hSL exactly, constituted the "power structure,' as well as who was impeding program 
progress. One person observed that Ae channels of communication could be characterized as "platitudes and 
generalizations; and AU^ are guilty of it** 

Another focus-group participant agreed with the cavalier manner in which CL-related announcements 
were communicated by administrators, providing a second example concerning this year's distribution of the 
Perception Assessment Scale (PAS) surveys. He/she pointed out that the PAS announcement was 
similai'ly garbled, leaving CL teachers with the (erroneous) impression that their participation was optional . 

Near the end of Uie focus-group session, one steering-committee member graphically summarized 
the inq)lications of perceived administrative apathy. This person commented that teachers would feel more 
of a sense of professional input and ownership, as well as reduced feelings of isolation generally, if there 
were more perceived support on the part of the administration. 
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Poor comnumication was also symptomatic of organiiationaKlimate problems, as discussed by the 
members of the steering committee. Respondents complained of a lack of foUow-up on comments, 
questions, and suggestions; one person said. "[We're] told to foUow the chain of command, but then it's 
dropped into a -black hole'; [there's] no foUow-up." Another observed, "... the ball gets dropped at a 
certain spot" Furthermore, there did not seem to exist a viable inter-organizational "grapevine" to help 
expedite the informal information-dissemination process. However, there was clear acknowledgement that 
these sorts of interiKisonal problems pre-dated the implementation of the CL progra^n. In addition, anotiier 
subject felt tiiat ". . . SOMF. people DQ get Ustened to." 

In addition to poor communication, die effects ofNEGATTVF communication were seen as 
extremely detrimental to organiiational climate by the members of the steering committee. Reminiscent of 
an issue that emerged during the first round of interviewing, one subject refened to tiie negative reporting of 
tiie Gallup newspapers concerning the low test scores, etc.. in the school district. Anotiier person pointed 
out tiiat tfiis negativity has been reinforced by tiie school board, whose members have publicly blamed CL 
teachers for tiie poor standardized-test-score results being reported in tiie news media. One steering- 
committee member also pointed out tiie ineviuble and harmful consequences upon tiie district's self-esteem 
and self-image of such publicity. It was suggested that "equal time" be given to "accentuating the 
positive"; e.g.. publicizing such successful results as tiie "host" program, whereby gifted students tutor 
tiieir peers. 

Expanding the overall issue of self-image, one person noted, "If you ask teachers, 'how often have 
you [received] praise.' it'd result in some low numbers." This comment generated considerable respondent 
interest and agreement, witii another individual describing a teacher who received only one positive 
comment in the evaluation process. 

Anotiier participant, citing the recent writings on "The Peter Principle" and especially tiie book In 
Se a rch QfEKCllcnri^ , suggested that building in "planned positive feedback" would go a long way toward 
correcting tiie low coUective self-image. It would also measurably improve inteipersonal relationships in 
general. 
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Interpersonal relationships were variously labeled as consisting of "suspicion", "jealousy," and the 
like. One person attributed the jealousies to the often-trivial objectives which supposedly relate to 
progressing up different levels of the ladder. Another steering-committee member felt that dissatisfaction 
was due to the policy of holding too many unproductive meetings. 

A number of dramatic and colorful quotes could best summarize the perceived poor state of 
organizational climate. There was clear and wide agreement vith one person's comment that, "This used to 
be a realOy] fun place to work; [now its] no fun anymore." Another individual noted, "The unhappiness 
surrounding you will rub off on the wganizational climate." "• . . if things don't change," according to a 
third subject, "weli repeat history." 

The overall tone of this area of discussion, however, was not entirely negative. The steering- 
conmiittee members made a number of specific suggestions to help improve tfie quality of organizational 
climate. They recognized die need for a better sense of teamwork among teachers. Subjects eagerly 
supported one person's proposal of the idea of "effective champions," or especially respected and recognized 
individuals wiUiin the district who have die necessary 'political clout' to see a good idea through to itf, 
implementation - akin to die concept of "opinion leaders" in group-behavioral psychology. Related to the 
previous issue of interest, another person felt tiiat more overt support and interest on the part of 
administrators would filter down to an improved organizational climate. 

The session wiUi die steering committee also dealt widi die issue of committee effectiveness. 
Committee meetings were characterized generally as being unproductive and inefficient by die steering- 
committee members. Some specific phrases used to describe its functioning included . . [a] band-aid 
operation ..." and ".. . [one in which] lots of problems get UNsolved . . The sporadic time-lines of 
committees came m for special criticism, widi one person observing diat communication typically shuts 
down entirely by late spring and summer, only to be followed by a deluge of required paperwork and tight 
deadlines. 

Wid) regard to program designs and structures, die need for clear and agreed-upon goals was voiced 
by steering-committee participants. As in previous areas, die need for solid administrative support was 
agreed upon as a necessary prerequisite for goal-setting to be maximally successful. Goals also needed to be 
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more tangible, according to one person, such as "to provide one hour of coaching during the normal school 
day at X school." 

Along these lines, it was also explicitly recognized by the group that student achievement and 
teacher accounubility needed to be the focus of program dcsiga One per^>on observed that "Teachers should 
make learning as easy as possible, and IHEN do the hard work resulting in learning!" Another spoke of the 
need to achieve a "good fit" between the student and the learning process. It was felt generally that teacher 
excellence USES, exist but IN ISOLATIQN. The recurring desire of greater administrative support was also 
mentioned at this point, as potentially inq>roving teacher skills development and accounubility generally. 

One particular aspect of program design came in for extended discussion by the members of the 
steering committee: the evaluation process. Respondents acknowledged the cumbersome nature of the 
process, especially for (already overworked) iraicipals who now, in essence, had to "keep two sets of 
books." While one evaluation might not be sufficient, according to another person, the request for repeated 
- observation and review would only over-burden evaluatcM^ to a greater degree. Perhaps in a related vein, 
another person con^lained of the relative terseness of most evaluation feedback: "If you get little feedback, 
it means [that] something's wrong!" One subject used a graphic and amusing analogy to characterize the 
consequent lack of trust: he/she likened it to an experiment with the highway patrol issuing 'good-driver' 
tickets, which was intended to improve morale but only served to increase suspiciousness and fear! Finally, 
the ratings themselves came in for scrutiny as to their actual validity. One subject described his/her own 
initial experience as an evaluee, getting "all fives" on the first evaluation. However, subsequently there was 
an external accusation of "easy raters," followed shortly thereafter by this person's ratings dropping. It was 
naturally hard for this person to tell if the drop signified a true decline in his/her teaching effectiveness or an 
over-reaction to the aforementioned rumor/accusation. 

The last major area of discussion with steering-committee members was the current lack of 
"readiness," as well as the need for a solid. long-range planning process, prior to the successful 
implementation of programs such as CLP. One perscm thought that the school district prematurely bought 
into the idea of EEI without sufficient scrutiny of possible alternatives: ". . . [it is] not a bad idea but not 
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the ONLY idea . . .r Another cxprcssec' a desire to . . put [the CL] on hold and get what we already have 
working well.** 

Focus-GrouP Interview with Prinrinak and Assistant Prinripak 

In a strikingly complementary vein to the discussion with steering-committee members, 
administrators devoted a considerable portion of their interview session to their own lack of percieved 
involvement and input into programs such as CL. They also acknowledged that the purpose of the CL 
program seems to have been widely misunderstood by the district. However, unlike the steering committee, 
administrators were far more inclined both to attribute other existing problems to the CL and to want to 
scrap the program. 

There seemed to be consensus that administrators have been unfairly excluded from key aspects of 
the evaluation process. On the one hand, they are requirec to do additional voluminous paperwork; 
however, they have no say in the CL placement process. This whole topic, in fact, yielded considerable 
emotional response, particularly expressed anger and frustration, on the part of focus-group participants. 
They also returned repeatedly to this area during the interview session. 

One administrator noted, 'Tm so confused about evaluations that [the process] has gotten me down." 
Another virtually thanked the moderator fw bringing up the topic in the first place, commenting, "IVe been 
woricing until 10:00 at night ... to get the necessary evaluation paperwork done." Another subject claimed 
that three-fourths of his/her time was being currently taken up by compliance with CL documenUtion 
procedures. 

This disillusionment was also evident with respect to the assessment of student achievement Whea 
the moderator attempted to open discussion of student achievement and its specific documenUtion with 
administrators, the reaction was ". . . [we] don't see it; [we] don't know how it's done." In fact, one 
principal claimed that he/she was not even shown the ITBS scores from his/her own district Another 
individual conq)lained of having unacceptable objectives submitted to him/her by a CL teacher - yet not 
having sufficient authority within the CL program structure to require satisfactory revision. 
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Principals* frustrations at being "relative outsiders" in the process also specific illy extended to 
commiitee-typt input and involvement For one thing, they claimed that there are too many such 
committees already in existence which seem to require administrators' attention. One person noted, Td go. 
not even knowing which committee Ym going to!" Another pointed out that meetings tended to be 
scheduled at times which were inconvenient for principals. A third commented (of his/her experience with 
the student progress committee) that, while it was initially a useful source of information concerning the 
CL program, the meetings gradually became more and more unproductive. The feeling concerning 
committees could perh^ best be summed up by the following colorful quote: ". . . (they have] no affect 
OffifiEKt!" 

A special case of this problem concerned principals* involvement in steering-committee activities. 
To be more specific, there seemed to be genuine confusion on the part of administrative focus-group 
participants as to whether they jkcic in fact, dc facto members of the steering committee in the first place 
(as claimed by one subject). 

With regard to CL program designs and structures, respondents' comments centered primarily on the 
perceived purpose of the program, especially as it was currendy being perceived within the district The 
monetary rewards appeared to be targeted towards those who write well, as well as those who executed 
meaningless projects, in the opinion of this group. Furthermore, the available funds were being primarily 
earmarked for greater salaries, at the expense of being invested in necessary programs to improve teacher 
effectiveness. 

The design process itself was criticized in relation to the preceding issue of lack of administrative 
input One individual characterized the process as "clandestine;" "... it must happen at night!" 

There was alio concern on the part of administrators as to teachers' placement and effective 
utilization within the CL program. One principal knew of ". . . four excellent teachers not making CL." 
Another person criticized the program's apparent tendency to assign the more gifted students to the CL 
teachers. This subject felt that, in terms of CL teachers' alleged improved skills development, that it should 
be the other way around. That is, CL's should theoretically possess the necessary capability for teaching 
the iQsi^-achieving students. 
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The administrators did produce a long Ust of suggestions in response to the moderator's probe for 
"what projects be instituted as pan of 'job enlargement'?" These included the foUowing: 

1 . taking students on field trips on weekends and after hours; 

2. participating in special activities, such as running the school newspaper; and 

3. offering tutoring and other services to students after school hours. 

In general, principals readily acknowledged teachers' wiUingness to stay after hours and to do more. 
However, they felt that this extra time was noi cunenUy being utilized to maximum effect, particularly 
within the constraints of the CL program. What was needed, in their view, was a candid assessment and 
sc/me creative brainstorming on ways that teachers' extra time could be used more effectively. 

The introducuon of the sub-area of evaluation resurfaced the administrators' concerns over the 
cumbersome nature of the process. One observed, "... we don't need 4-5 pages! We alread.- know the 
good teachers." Another re-expressed concern over the trivial nature of the objectives being set by teachers. 
A third voiced some confusion over complying with the letter, as opposed to the spirit, of some of the 
overly-specified ground rules of the evaluation process: "If a lesson plan is not turned in, do I give [that 
teacher) aU reroes?!" As before, the administrative focus-group participants bemoaned their perceived lack 
of input generally. 

With regard to teacher accounubu. the principals admitted that there are too many other 
uncontrollible variables which can impinge upon the single numeric measure of student gain, which 
cunenUy typically go unnoticed. This was especially true in the usage of standardized test scores, such as 
thelTBS. 

A final overall point regarding the evaluation process had to do with principals' ongoing role. It 
was stressed, by one focus-group partic'oant, that there ]S day-toKlay monitoring and observaUon relative to 
student growth: "We haven't lessened our responsibilities in any way." 

Principals did provide positive feedback concerning the perceived effectiveness of peer evaluators. 
The latter were characterized generaUy as being "nice people." One individual peer evaluator was singled out 
for special praise at this poinr for being a ". . . hard worker, enthusiastic, [and] fair, valid [e.g., her 
evaluations agreeing in general with those done by principals for a given teacher]." One administrative 
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f ubjeci sugg^ted that perhaps ONE person should be delegated the task of doing ail of the peer evaluations. 
In this respondent's opinion, such a policy would help alleviate the widespread complaint of too much 
disnipdon of the learning process, as a result of Ae [multiple] peer evaluators being pulled out of their own 
classrooms periodically. 

Nowhere was the misundentanding relauve to flie goals of the CL program mott evident than in the 
response given to the moderator's comment that the goals of CL and "effective schools" are theoretically the 
same. The answer was a puzzled, "THEY ARE?" Another person added, at this point, that the general 
feeling was that the primary goal fo CL was "to pay teachers more money"; in fact, this comment was 
attributed to the student-progress committee itself. 

One negative aspect mentioned had to do with perceived inequities attributed to program 
designs and structures. One person noted his/her futile attempts at getting CL's to volunteer for extra 
duties, such as helping out with school dances in the evening. In this person's opinion, CL's routinely 
ducked such duties, as "theyVc not academically oriented." On the contrary, principals . elt that "... if you 
get paid more, then you should give moa ." 

The area of organizational climate was characterized in primarily dysfunctional terms by the 
administrative focus group. In particular, principals felt "caught in the middle" between warring CL and 
non-CL factions. With regard to a perceived lack of teamwork one person noted, "... it takes two to three 
days after a CL meeting ... to bring teachers back together." The cltnate was also described as consisting 
of overstressed individuals and correspondingly low morale. 

Money received only scant attention in its role as an extrinsic motivator. The comment was made 
that ". . . some teachers [are] willing to jump hoops for money; but there are good teachers wh [aren't* 
willing]." 

As with the steering committee, there was criticism of the lack of long-range planning and the 
disregard of essential "readiness" factors. That is, there was a c * sense of "crisis-type management" being 
followed: "[Plans currently] develop as we go along." Administrative subjects readily acknowledged the 
long-range nature of any corrective process with regard to successful program implenienution. They agreed 
that positive changes might not be readily appaiont for a number of years. 
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The school board was described by administrative focus-f;roup participants as being "too new" for 
them to gauge its potential effectiveness. One person commented, "I don't thing they [board members] 
know enough to solve problems." 

Focus-group participants also readily generated a list of suggestions for improvement (Returning 
to their frustration with perceived lack of input, one person pointed out that they had suggested such things 
in the past but had never received any follow-up on their ideas.) These suggestions included the following: 

1 . more research relative to the concept of "cooperative learning;" 

2. brainstorming on more ways to involve parents; 

3. moving generally in the direction of "school improvement," with an acknowledged need to 
allow an eight-year minimum if necessary for long-range changes to be apparent; 

4. a "one-lane salary schedule," with a minimum of required inservice and participation bv all 
teachers; 

5. a clearly adJiowledged need to find better ways to reward and motivate the truly effective 
teachen (memorably and colorfully summed up by one administrator as, "[We] need the cream 
of the crop to rise to the top!;" and 

6. more money budgeted to teach, demonstrate and inqnove teacher skills, as well as to revamp 
and streamline the evaluation instrument (as opposed to being earmarked entirely/primarily for 
salary increases). 

As mentioned at the outset, principals tended to blame the CL for existing problems and to want to 
see it scrapped. A more moderate opinion was expressed that "We should review CL for a year and start 
over." The most important point to be kept in mind, according to another respondent, was that the CL 
should be designed to fit the needs of an individual school; and NOT vice versa. (This individual 
graphically compared the current implementation process to the tossing-around of a beach ball; he/she 
characterized the CL coordinator as being buffeted by the shifts in power between competing interest 
groups, with resultant instability in program rules.) A third individual suggested that perh^s a program 
such as CL could be more effectively incorpcx'ated under an all-encompassing "umbrella" program such as 
"effective schools." By doing so, this respondent felt that the incentive program would benefit ALL 
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teachers, as opposed to a "se)©:ted elite." Moreover, its goals would be more in line with effective 
instruction as a result. 

Focus-Grpup Interview with Career Ladder TM^hm 

In this particular foUow-up session, there was repeated reference to the "low-self-esteem" problem 
touched upon in Ae preceding two groups. Career Ladder teachers also expressed detailed interest in the 
areas of leadership and organizational climate. 

Respondents readily acknowledged that administrators currently ^ • . don't have a buy-in ..." into 
the CL program. One principal was characterized as not coming to the necessary training session and 
therefore not knowing how to use the CL evaluation instrument. In fact, there was wide agreement that 
administratOTs* attendance at related meetings and woricshops has been sporadic at best. As a result, they are 
unable to keep up with the latest developments in CL program requirements. 

One CL subject characterized administrators' actions generally as inconsistent: "Principals shift 
gears . . Another complained of principals* observed tendency to put off necessary tasks until the last 
minute. 

Problems such as the above were attributed by CL focus-group participants to insecuritv on tfie part 
of aoministratCM^. More specifically, administrators were characterized as afraid of losing tiieir jobs. In fact, 
one CL teachci' made the point that, in terms of organizational climate generally (to be discussed in greater 
detail below), perceived insecurity was attributable not lo teachers, but to administrators. 

The topic of organizational climate produced some clear and forceful agreement on tfie current state 
of problems. There was a shared perception that the CL program was being blamed for problems which 
actually existed sdoi to its inception. Another individual made mention of vocal CL critics who couldnX 
or wouldn't, produce a rationale for their complaints. (A gr^hic example of such 'groundless critics* was 
provided by one individual, in his/her account of the CL application process. This person recalled being 
told by a dissenter that ''The good teachers aren't on the CL!", yet receiving no response to hii'her question, 
"How do YQU know?!") Such problems were attributed by the respondents to fear associated with the 
existence of CL, as as "passive resistance" to the program, 
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In a sharp difference in focus of discussion with their non-CL counterparts, CL teachers ^ere 
unanimous on the point that they DO, in fact, interact and share ideas with non-CLs. As one person 
pointed out. "We'd be ostracized [otherwise], since we're in the minority!" A humorous counter-example to 
this accusation concerned the focus-group scision itself. One participant me»itioned that the only thing 
he/she has tried to "hide" from non-CL's was his/her attendance at the focus-group itself - obviously fearing 
retaliation, ostracism, etc., on the part of the non-CX subgroup. 

One especially prevalent problem with organizational climate was the issue of insufficient 
communication. One CL teacher told of not being informed that certain of his/lier students had prior 
permission to leave class to attend Federal programs - thereby resulting in their being placed on the "ditch 
list" in error. 

The area of collective self-esteem came in for detailed discussion with regard to the expressed need 
for increased feedback and support There was clear positive response and unanimous respondent interest 
when the moderator observed that the school district ought to have a ". . . better self-concept tfian most" 
This led to the response that teachers tend to operate in isolation in this district There was also wide 
agreement with the comment that "We need to be told that we're doing positive things." As with previous 
groups, mention was made at this point of the negative (and potentially harmful) reporting on the district 
being done by the Gallup newsp2q)ers. 

In terms of internal rules and regulations, another consistent source of indignity and lowered self- 
esteem was identified. One CL teacher complained of having to stand in line for one's paycheck, as opposed 
to receiving it personally (along with a "thank-you") from the principal, at least once during the school 
year. 

Respondents had no trouble producing a list of workable ways to incorporate image-building into 
day-to-day operations. Suggestions included the following: 

1. a monthly newsletter (publicizing positive outcomes) issued by the superintendent and/or 
school board; 

2. disseminating a similar newsletter to the parents and to the community at large, perhaps by 
placing it in banks, etc.; and 
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3 . printing the honor roll. 

At this point, an exchange took place which was perhaps symptomatic of the insufficient feedback 
and conununication being reported by participants. One subject (in generating the above list of 
improvements) mentioned more effective utilization of the school district's "RR. person." The comment 
was met with widespread confusion and surprise, causing another individual to ask, "Oh, we HAVE a PJR. 
person?!" 

The area of effective leadership was discussed from several aspects. There was clear and unanimous 
agreement as to the need for "long-lived leadership," as well as an overt commitment to long-range 
plannirg. However, the current decision-making process was depicted as clearly ineffectual. For one 
thing, there was a perception of "information being locked up in committees." Later on in the discussion, 
another CL focus-group participant noted that there are "A million committees; and: 1. no one knows what 
they all are; and 2. the 'core group' will be a problem [in dominating these committees]." 

The CX program coordinator was faulted on several grounds. Pint of all, he was perceived as not 
exercising his mandated authority to maximum effect In particular, he was described both as afraid to take 
a stand on key issues, and trying too hard to pacify too many diverse factions. The coordinator came in for 
particular criticism for exte ^ding compliance deadlines in what was perceived in an arbitrary and capricious 
manner. Some subjects thought that he did this because "... he hates to have people dislike him . . 
however, as countered by another individual, ". . . 'niceness' works at the start only ..." and can clearly be 
overdone. 

However, the participants also had a number of positive conrmients to make regarding the 
coordinator. He was praised for being a good listener; "... his door is always open." They also thought 
that in many instances he was being put in the position of "scapegoat" and not seriously listened to, in 
return, by the powers-that-be. 

The steering committee was described by CL teachers as actirtg somewhat in isolation; however, CL 
participants also thought that this isolation was of its own volition. The school board, as in previous 
interview sessions, was characterized as "... too new and afraid . . to effect any meaningful reform. 
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A number of observations were made relative to CL program designs and structures. One person 
characterized the CL process as "a writing contest." Another thought that there ought to be more explicit 
position descriptions. He/she specifically referred to menlor-teachen being "boxed in," and "in a gray area," 
with subsequent confusion and evasion of key responsibilities. 

With regard to recmitment and retention, there was unanimous agreement with the opinion that CL 
program participation should remain VOLUNTARY. For one thing, a teacher close to retirement would 
probably have no real incentive to apply. Another person mentioned that forced participation would result 
in anger and resentment, which in turn would further harm the state of organizational climate. However, 
there was also a pervasive feeling that more teachers perceived as "capable" SHOULD be on the CL 
program. Yet, in an interesting summary dissenting opinion, one teacher pointed out, ". . . more people 
ARE buying into it [CL] each year, applying and hanging in there - so somehow it's GROWING !" 

One rather unique aspect of the CL program which triggered a fiery emotional response from CL 
focus-group participants had to do with the program name itself. One person objected strongly and vocally 
to the "merit-pay" aspect of the system, which was often (and erroneously) used synonymously with CL. 
However, there was an interesting response given to the emotionally loaded connotations of labeling. One 
person gave the example of someone saying "focusing" would be done in his/her classroom - and yet 
the particular teacher was probably doing it anvwav. without even realizing it. 

As with other groups, the evaluation process came in for detailed discussion. There was some broad 
agreement witb the cumbersome nature of the documentation process, including the fact that it probably 
deterred some potentially good teachers from applying for the CL in the first place. A large number of 
focus-group participants agreed with the expressed need to streamline and collapse some of the current 
categories. One person reminded participants that the current system had been more or less "thrown 
together" a year ago and adopted somewhat in desperation. There was also dissatisfaction expressed with the 
"nebulous" nature of some of the specified criteria. 

Not everyone saw the detail of the evaluation instrument as a negative, however. According to one 
CL teacher, the detail was, at least, "clear-cut," which in turn could help to foster a perception of greater 
fairness on uie part of evaluees. Moreover, while some persons thought that the length of the instrument 
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promoted bumout on the pait of teachers, others felt that there was a perceptible improvement in 
streamlining the evaluation process in recent times. 

Peer evaluators were also exclusively praised by CL focus-group participants. One individual 
characterized them as "fair and honest" Another said (combining perceptions of the detailed evaluation 
process as weD as the peer evaluators): . . everything is documented" Another noted. "[The process] 
takes time, but at least you have professionalism . . 

The need for greater parental involvement in the learning process also emerged ftom the CL follow- 
up focus group discussion. Teachers referred to their frustrations and (often-futile) attcn5>ts to get parents 
more involved. Furthermore, their specific suggestions for increasing parental involvement appeared to be 
squelched by top administrators, analogously to other ideas submitted. 

Motivators (intrinsic and extrinsic) received relatively scant attention from this group. With regard 
to the moderator's request for euuiq)les of the former, only one comment was made: "... others see you 
are being responsible for everything." Virtually no discussion about money ensued, except for one teacher 
who expressed surprise that (with regard to program designs and structures dealing with salary increases) 
"the amount had changed." 

Long-range planning and readiness factors yielded the same sorts of comments that were made in 
other focus-group sessions. There was clear agreement with the moderator's contention that a workable 
program could conceivably take six to eight years to dcwdop. One teacher observed, "So many things are 
imposed and [subsequently] dropped." 

Fncus-nroup Interview with Non-Caree r Ladder Teachers 

Surprisingly enough, the topic which generated repeated interest on the part of these subjects was 
the issue of student achievement. These teachers also expressed detailed concern about the evaluation 
process. Organizational climate, and collective self-esteem ^n particular, warranted special attention. 

Poor communication seemed to characterize the current sute of knowledge about documenution of 
student achievement Participants were unable to respond to the moderator's question, "How is student 
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achievement being documented?" Subjects attributed this lack of Ir.owledge to the "isolation" and 
'^fragmentation'* which seemed to characterize the district generally, 

Non-Career Ladder teachers also spent quite a bit of time in this area conq>laining about students 
who possess a cavalier attitude toward standardized test-taking; in effect, according to these subjects, they 
mark anything at all on their test papers. When the moderator suggested seriously teaching test-taking 
skills, one teacher replied that this strategy HAD been tried but to no avail. There was wide agreement with 
one teacher's comment that "They [students] CAN learn how [to take tests; but] they WONT ." Thi^ 
problem was attributed by focus-group participants to parental unemployment and parents* not appreciating 
the usefulness of schooling generally. When the moderator spoke of the interest expressed in the fint 
parents' focus group, the reply was that such parents are "atypical." 

Discussion of the evaluation process yielded some memorable examples of dysfunction. One non- 
CL teacher bemoaned the fact that CL*s get "points" awarded for such activities as "playing a clown," 
"blowing up balloons," and the like. There were also accusations of measurements and written evaluations 
being "doctored," as well as an account of one CL teacher who keeps four specially prepared lesson plans 
just for evaluations. One person attributed this to an inordinate pressure felt by all teachers to account for 
student progress. 

Organizational climate was characterized primarily in negative terms by the non-CL group. In 
particular, they spoke of divisiveness and ill wiU between CL's and non-CL's. There was expressed 
resentment at special privileges allegedly being awarded to CL teachers, such as release time to attend 
workshops. One non-CL teacher complaineu of being forced to give up scarce planning time in order to 
attend CLs* so-called "isolated little projects," being conducted for the sole purpose of accumulating points 
for CL teachers. Another person resented having to cover CLs* responsibilities "while they go and 
observe." There was agreement with this point; one teacher noted the resultant tension and disruption of 
efficient teaching due to teachers being pulled out of their own classrooms. Finally, there was the familiar 
(from the last session) allegation raised, concerning CLs* apparent unwillingness to communicate and share 
ideas with non-CLs. 
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The program itself took a large share of the blame for these climate dysfunctions. One individual 
characterrtd the CX program as **a pecking order,** with "no team-building;" he/she added that **cach teacher 
cares about his or her own domain" only. The CL program was also described by another subject as 
"political," with "ins" and "outs." 

However, an interesting thematic turnaround took place when the moderator remarked at this point 
that the non-O-'s seemed to be the ONLY ones blaming the program for problems which others believed 
had in fact pre-dated Career Ladders. At this comment, there was also wide agreement that . . [there were] 
cliques before this [CL] came . . .." The nKKleratw probed for attitudinal direction by remarking, "It's 
amazing that a PROGRAM could do that!", to which one reply was, "It's NOT the PROGRAM : i(s the 
PEOPLE !" 

With respect to low collective perceived self-esteem, there was a generally expressed perception 
among the non-CL teachers of "not getting sufficient strokes." One person recalled being told that the 
school system was "... a camiverous place," to which he/she replied, "Well, I AM one!" 

There was a pervasive belief on the part of non<Xs Aat the CL teachers are interested only in the 
extrinsic motivator of money. On the other hand (related to the above topic of self-esteem), subjects felt 
that another, intrinsic, motivator was potentially more powerful: "A moment of appreciation is worth 
more than money.** Another individual felt that those who make twice as much money should in turn do 
twice as much work ... as opposed to one-half, which is the way in which CL's were perceived, 
productivity-wise, by this respondent. 

Administrators earned some sympathy from the non-CL's for having to do additional paperwoik 
required by the CL program. There was also wide agreement with one person*s contention that principals 
act fairly and do not ^pear to show favoritism. 

Respondents used some colorful phrases to describe the hasty way in which CL was implemented. 
One commented, "It was SHOT IN. as opposed to WEANED TN, " Another remaned that it " . . . hit from 
the superintendent and splattered . . .." Such haphazard implemenution was evidently characteristic of 
program phase-ins; a third person stated, 'So many programs are in and out; we don't know how long 
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they'll last" A fourth individual attributed this problem to greed; he/she felt that the sole motivation for 
the district's bringing in a program like CL is to get Federal dollars. 

There was clear and overt agreement when the moderator attempted to summarize the non-CLs' 
apparent sources of dissatisfaction. Among the problems charactarizing the district, the following seemed 
to be most serious: unacceptably low collective self-esteem; stress; inteigroup and interpersonal hostilities; 
"no happiness" generally; and program elements operating in isolation, with no coordination in 
implementation. Finally, there was applause at the end of the session when the moderator suted, "You 
need to establish a •success* program for the kids; con^are them on 'successes'; NOT failures'!" 

"Open-Meeting*^ Focus-Gr oup Interview 

As suted in the introduction to this section, the researchers decided to set up an open-forum 
meeting, in order to accommodate those subjects who did i.ot have an opportunity to participate in one (or 
both) of the regularly scheduled sessions. This interview was well-attended and yielded comments which 
triggered high levels of respondent interest and feedback. 

The largest single issue discussed by the heterogeneous "open group" was the area of evaluation 
systems. There was repeated and multiple dissatisfaction expressed with the idea of a single summative 
evaluation as supposedly "representative" of a teacher's activities and capabilities. One recent CL applicant 
characterized the evaluation process as ". . . just a one-shot deal to showcase everything . . ." where, in fact, 
it should also be a "learning situation," whereby a teacher can c(Hrect deficiencies. Another person noted the 
overt sense of relief on the part of teachers when the "single" evaluation was over. A third c*':^scribed a 
colleague who used the SAME lesson plan for submission U) the principal and the peer evaluator. A fourth, 
teacher claimed that he/she never received the (theoretically required) follow-ap post-session with the 
evaluator. 

There was also heavy criticism from this group concerning the cumbersome ps^rwork required in 
the evaluation process. "[There is] too much paperworic on nothing." "[We] owe the kids more than just 
paperwork." Anoth'^r participant singled out the computer for adding to the paperwoilc burden, as opposed 
to helping to expedite it. However, this was countered by an opinion that the process did seem to be 
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getting more streamlined duri -eccnt times; that is, . . more down-to-earth; more concrete." Another 
person concurred, describing a prospective MIS (management information system) installation as a way of 
further streamlining the documentation. "... to centralize and avoid duplication of efforts." 

One vivid and detailed suggestion was made regarding a proposed alternative evaluation system: 
make one brief lesson plan weekly; send one copy to the CL office; and also submit a daily diary of 
activities (the last to be used as an aid in the teacher's daily planning activities, in addition to providing 
detailed and multiple documentation to evaluators). This person also felt that the summertime could be put 
to better evaluative advantage, by reviewing the entire stafi during this period According to this 
respondent, such documentation would resolve the problem inherent in "... a single lesson plan 
constitut[ing] 180 days . . .." 

The second major area of focus for the open group was the area of CL program designs and 
structures. There was clear agreement that the program components currendy appeared to be operating in 
isolation. Considerable concern was also expressed that the CL program is TEACHER -oriented, as opposed 
to STUDENT-ftriftnted In general, the imvdinate amount of time needed to comply with the voluminous 
program requirements was perceived as hurting teacher effectiveness. "Change-for-the-sake-of-change" was 
also recognized as a problem in program implementation. Finally, the placement process came under fire 
for not addressing individual teacher differences sufficiendy or adequately. 

Organizational climate was not as negatively described in the open session as in other focus groups. 

One person characterized the alleged negauves as ". . . more 'misunderstandings' than 'hostilities' " 

Some conflicts and Jealousies had admittedly been observed by participants; however, when the moderator 
asked "Who's responsible?", the clear and immediate reply was "ALL of us!" All subjects agreed that 
communication needed to be improved. 

With regard to motivators, only the extrinsic motivator of money was mentioned. There was an 
apparent perception of CL's 'selling out' for additional money, with one respondent noting, "fl] wouldn't 
hurt the students for an extra $ 8,(XX)." 

There was support expressed generally by this group for the efforts of the CL program coordinator. 
One person commented. "I've heard people putting down [the CL Coordinator], but he's doing his best . . 
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There was understanding and agreement that he could not be expected to effect major changes in a 
relatively short period of time. 

The last major topic of concern for the open group was the need for long-range planning and 
sufficient levels of "readiness" of key factors prior to program implemenution. Past approaches were 
characterized as . . shotgunning it . . Another person advised, "Lct*s do fins thing at a time!" 

Summary Comments: Second Series of Focus-Group Tntgnni>w !c 
The five separate interview sessions resulted in considerable convergence of opinion as to problem 
areas. To begin with, the area of administrative leadership was seen as deficient There was agrtement, 
however, that principals and assistant principals critically need a "buy-in" into programs such as CL in 
order to justify their abeady-scaice time and efforts on program con^liance requirements. 

CL program requirements were faulted on several grounds. As before, the biggest complaint 
concerned CL teachers being removed from their classes for frequent attendance at special workshops and 
meetings. This policy created distinct problems from two penpectives. In the first place, studentsMeaming 
processes were seen as being needlessly disrupted by the repeated absence of their "regular" teachers. 
Moreover, non-CL ieac!iers appeared to resent what they perceived as "special privileges" awarded to their 
CL counterparts, in the form of workshops which were not open to non-CL participants. 

The evaluation process, despite acknowledged efforts at streamlining in recent times, was sUlI 
perceived as way too cumbersome. Others criticized the seemingly trivial objectives being set and for 
which CL teachers were currently being awarded points in the evaluation system. The open group, in 
particular, felt that a single summative evaluation was invalid and deprived the teacher of demonstrating 
improvement in technique. Finally, some of the current criteria were characterized as being too vague. 
According to all participants, goals should focus more clearly on meaningful student-achievement 
outcomes. 

On the other hand, one positive comment was consistendy voiced relative to the evaluation process: 
the quality of peer evaluators. Most participants felt that peer feedback was genuinely and practically 
helpful. 
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There seemed to be unanimous agreement on two key points. First of all, participants felt strongly 
that there should be a single evaluation instrument for CL and non-CL teachers. Secondly, they felt that 
CL program participation should remain voluntary. 

The CL coordinator, while acknowledged by some as a "good listener" and a "nice person," was 
again accused of bending the rules, such as tolerating late submission of paperwork. By doing so, he 
evidently sabouged his own self-image; instead of being perceived as "nice" for doing so, participants 
questioned his sense of fairness and decision judgment in such ^^ises. 

"Poor communication" was an almost universally-yoiced complaint with respect to organizational 
climate. There was overt hostility between the two groups of CL and non-CL teachers. One source of 
stress which once again came in for extended discussion was the problem of "unsubstantiated griping" and 
its harmful effects upon morale. 

On the district-wide level, a special problem which almost all groups mentioned was that of low 
collective self-esteem. This chronically poor self-image was attributed primarily to the glut of negative 
reporting about this rural school system in the news media. Respondents recognized the need for equal 
attention to be given to the positive aspects of their students' and teachers' achievement Along these lines, 
there was also an expressed desire for greater community (especially parental) involvement in the scholastic 
activities of the district. 

Another unaninx)us conclusion from the se^^ond series of focus-group interviews was the tendency 
of CL elements to operate in isolation. A long-range planning process was seen as absolutely essential to 
the ultimate success of program iiTq)lementation. 

Conclusions and Recommendations 
A number of observations can be made regarding the support and focus factoid of the developmental- 
process model as a result of Jie two focus-group interview sessions. General conunents emerging, from 
both sets of interviews include die following: 

1 . The district must devote sufficient time and start-up r ources to a carefully formulated long- 
range plan (of six to eight years' duration), in order to help insure the success of programs 
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such as CL. Objectives need to be set via consensus-style management in order to help ensure 
support from all groups involved in various phases of the implemenution (administrators; 
central-office staff; teachers; community representatives; etc.). Time, patience and consensus- 
style operation would help prevent some of the problems (both those related to 
implementation and interpersonal difficulties) of the *'crisi:>-style*' management currendy 
observed with regard to new-program adoption in this rural Arizona career ladder school 
district. 

In formulating such objectives for program success, the goals to be set for teachers should be 
clearly focused or accountability for tangible and meaningful student outcomes. A jointly 
developed curriculum would help to clarify objectives to be met, as well as provide avenues 
for the input of div,*ne groups (such as those listed in # 1, above) relative to the long-range 
planning process. If possible, standards should be set for tracking social, emotional and 
behavioral outcomes, in addition to the more traditional academic indicators of student 
achievement 

CL participauon shonld be kept voluntary. In addition, the current practice of placing many 
new applicants on Levels III and IV immediately needs to be re-evaluated, and discontinued if 
possible, due to the negative effects upon organizational climate (jealousy; insecurity; etc.). 
One idea which emerged in the interviews was a minimum amount of education ( holding a 
master's degree) for acceptance, akin to licensing requirements for professions in the private 
sector (e.g., a minimum number of credits and/or degree requirements for candidacy as a 
certified public accountant). Perhaps similar "threshc' T requirements could be developed for 
the higher CL placement levels, to discourage i diatc placerr ni at these levels for all 
practical purposes. 

Program leaders need to explore ways to avoid removing CL teachers from their classrooms 
for frequent and extended periods of tin^e in order to comply with program requirements and/w 
to attend special meetings, workshops, etc. 
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The number of committees needs to be streamlined. A more efficient information- 
dissemination process needs to be adopted with respect to announcements of meetings and the 
like, so that aU potentially interested parties are informed well in advance of meeting dates and 
times. 

A single evaluation instrument should be adopted for all teachers, both CL and non-CL. This 
would improve the perception of "fairness" by aU teachers in the overall evaluation process, as 
weU as reduce the paperwork burden (e.g., necessity to "keep two sets of books") on the part 
of already-overworked administrators. 

The evaluation instrument should be streamlined, with the number of overt criteria reduced; 
e.g.. collapsed into a fewer number of general factors. 

Immediate and concentrated attention should be devoted to publicizing the positive aspects of 
this rural school system. This would counter the damaging effects upon coUective self-esteem 
of recent media stories concerning the "below-average" performance of this school district's 
studt^ts, etc. Such positive counter-publicity might also have the desirable effect of 
increasing community awareness of» and involvement in. academic activities. It was pointed 
out in the parents* interview session that tremendous untapped resources already do exist in the 
district which could be used to enhance traditional classroom activities, and thus, learning. 
Development of a "high academic profile" in the local school district news media could 
effectively trigger greater community interest in such participation in activities related to the 
learning process. 

Administrators currently have no incentive to devote their already-scarce time and efforts to 
programs such as CL. On the one hand, as pointed out in point # 6. above, they are required 
to do additional documenution on their CL teachers. However, they have no authority or say 
in the program requirements, such as the placement process. By providing "buy-ins" for 
administrators via explicit program designs and structures, these leaders will feel a greater 
sense of "ownership," thereby choosing to increase their involvement in program-related 
activities. 
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The focus-group format is a powerfui tool for the validation of theoretical models, such as the 
support-and-focus-factor model, in actual program settings. By giving all groups affected by the program a 
chance to express their feelings, opinions and perceptions in open-ended format, one can determine the 
existence, importance and inteirelationships of these factors as they actually operate in a specific context. 
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